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ABSTRACT 

This study is one of a series of studies conducted or 
planned by the authors investigating the information processing 
strategies employed by students who are placed in a 
quasi-instructional setting of learning from text with questions 
interspersed. The subjects were 65 undergraduate students from two 
introductory educational psychology courses. Three factors were 
investigated: questioning procedure, instructions, and scales. Two 
question positions were investigated: (1) subjects answered questions 
just before relevant text portions, and (2) subjects answered those 
same questions after reading the relevant text portions. Instructions 
to subjects were of two types: Part, which indicated that the 
inserted questions were only a part of the questions which would 
appear on the criterion test, and Total, in which subjects were 
instructed that the inserted questions represented the total 
information they were expected to learn. Some of the results 
indicated: no differences were observed on practiced items; Dunnett's 
test revealed that the control group exceeded the experimental group 
on non-practiced items; and the control group was fastest on practice 
retention . (Author/WR) 
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This study is one of a series of studies conducted or planned 
by the authors investigating the information processing strategies 
employed by students vjho are placed in a quasi-instractional setting 
of learning from text with questions interspersed, ifost of the research 
on this topic has been conducted under the ruber io of iiathei.iagenic^ 
(See Rothlcopf, 1970) • Generally, these experiments have shown that 
questions inserted in text have increased retention of irtat-erial di- 
rectly covered by the interspersed questions (practiced items) as 
compared to unquestioned controls. Further, it has been shown that 
questions inserted after text segments to which the question is rele- 
vant can facilitate ret^ion of material not directly tested by the 
interspersed questions (non-practiced items) as compared to questions 
before or no questions (See Jfase, 1970 for a review) • 

Carver (in press) has criticized these studies on several grounds, 
one being a failure to adequately control or account for subject stra- 
tegies in dealing with the text and adjunct questions. Specifically 
these studies have left S uninstructed concerning the nature of the 
criterion tejtt and the exact relationship between criterion test items 
and interspersed questions. Carver has argued tHat the ambiguous 
nature of instructions to Ss concerning these mat^^ers could seriously 
influence the observed effects of question position and cast doubt 



upon the interpretations that RothJcopf and others have given to their 
results • 

Processing strategias employed by lear'^ers have also been exa- 
mined by Keller and Cunningham (1972). These authors proposed an 
information search model of learning from text with questions inters- 
persed in which S's search strategies viere presumed to be under rather 
direct control of environmental constraints , such as instruct ions# 
In treatments nhere questions precede text segments (QB), Ss were pre- 
sumed to enter the question into memory and rehearse it so that it 
V70uld be available in nemry when S turns to the text and begins read- 
ing. Reading was viewed as an iniormation search activity where the 
reader scans for Information pertinent to the question. :laterial not 
deemed pertinent will receive less processing and, therefore, not be 
as vrell retained as the pertinent inaterial. In treatments where 
ques^\on3 follow text segments (QA) S was characteru^ as r«adlng the 
.'oaterial, trying to incorporate as much of it as he could so tart it 
would be available in memory'" when the question is encountered* When 
S does encounter the question he retrieves the pertinent information 
and transforms it to meet the demands of +he question* This fi^rther 
processing of the pertinent material malces it more me-aorable than 
other information in the p?,S8age. 

The present experiment represents an attempt to invest i^^ate the 
influence of directions to S concerning the relation betx>re^en the 
criterion trest and the adjunct questions* If Carver (1970) is corredt 
that some Ss ^^re intf^rpretin'? the somev^iiat ambif^ious instructions used 
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in prior questioning studies in difi'erent ua/s and that different 
interpretations v/ill lead to differential search strate-^es on the part 
of Ss, then it should be possible to predict consequences of various 
strategies, specifically, we believed that telling Ss that they would 
be tested only on the content tested by the adjunct questions would 
increase the advantage of Q^i groups on non-practiced material since 
the QB group coLild (if they were so inclined) narrow their concentration 
to a £reat extent to the practiced content. The QA group cannot, of 
course, narrow their search behavior since they are uncertain as to 
which content will be tested. Thus, if S strate^iies are under control 
of instructions, an interaction between question position (before or 
after), instructions, and retention (practiced or non-practiced) should 
be observed. The present study vjas undertaken to investigate this 
possibil ity# 



liaterials 

The materials selected were those previously used by Frase (1968) 
and adapted accordin;;ly for this experiment* The material consisted of 
a continuous prose passage of biographical material about vJilliam James 
from Psychology ; The Science of Heatal Life, by Miller (1962)*' The 
material was divided into twenty paragraphs, each paragraph on a sepa- 
rate sheet of $ X 8ig-inch paper. The i?'rase materials :3rovided two 
multiple-choice questions (five alternatives) from each paragraph 



which required the recall of specific factual inforniation from that 
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paragraph. The bwo questions \^ere constructed so as not to overlap 
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in content. Tventy questions were ur-ed as practiced (?) questions on 
the post-test. These questions were i/serted during the learning 
session Tor those groups -.Vii-ch received before or aiter questions. 
Trie other set of tvxenty questions vras used to test non-s^ractlced (NP) 
learning. The forty-item criterion test was .mimeographed on five 3h 
X 11 sheets of paper. Twenty practiced pnd twenty non-practiced 
questions were randomly interspersed thoughout the test. 
Subjects 

The Ss vjere sixty-five undergraduate students from two intro- 
ductory educational psychology courses at Indiana -'niversity. Pc-.rti- 
cipation in the expsrimental study vas a course requirement. Subjects 
were run in their classrooms xrith assignment to treatment randomized 
WLtnin class v;ith the restriction of equal cell sizes. 
Design and Procedures 

Three factors were investigated in this experiment: 'iuestioning 
procedure, Instructions, and Scales. Two question positions were in- 
vestigated: (l) QB in tjhich Ss ansi^rered questions just before relevant 
^ext portions, and (2) in which Ss answered tliose same c.uestions 
after readin,^ the relevant text portions. Instructions to 3s were of 
two types: Part which indicated to Ss that the inset'ted questions 
were only a oart or subset of the questions which would appear on the 
criterion test} • and "Total. which Ss x^ere instructed that the 
inserted questions represented the total information they were ex]:>ected 
to learn. 'The Scales factor \jas a repeated measure: P test items 
versus HP items. Tt-jo question procedures and two iBhstructional sets 



produce four treatment conditions (n = I3 in each). /. control jroup 
(n « 13) uas also run vmich had no interspersed question and who vere 
simply told the^ i-ould be^'tes t^il Lht Tcofiient or the passage. Each 
S worked through the text at his ovm rate but wr.s not oermitted to 
revievr the text. Ii'naediately upon coinpleting the text all treatment 
groups and the control were adiainistered the forty ite^n criterion 
test. In addition, Ss were asked to record starting and finishing 
times on the rnaterials. 

Results and Discussion 

To examine the relationships between the Tour treat-nents and the 
control groups, two one way analyses or varionce were conducted, one 
using P items, the other MP iieiiis as the dependent measure. No difier- 
ences i/ere observed on practiced items while on non-practiced items, 
Dunnett^s test revealed that the control group exceeded the SB-Total 
group (p<.05) and nearly exceeded the SB-Part group (.0$ <p <«06). 

A separate analysis was conducted with the x^'ive groups using time 
to complete the text loaterials as the dependent measure. On P retention, 
the control group was Tastest, as expectecl Gince they ansi^ered no ques- 
tioas but ^there were no treatment group differences. On retention, 
the control group;i >?«e si^^niiicantly faster (p< .05 using Dunnett's 
tost) than the two groups with questions before. No other differences 
were significant. 

The treatment effects of mjor interest were analyzed by a three 
factor (2x2x2) repeated measure analysis of variance as implied in 
the design section above. The analysis shol^red a significont main effect 
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for Scales (p <*01) inOlcating that vhe retention of ? iteas ':as 
hi'^Iier than retention of VP ite:.s Tor all treatment groups. Z.e 
only other signlf icr.nt (p < .01) source of variafxce uas the inter- 
action tet^.reen Scales and Question position, a finding -rhich confirms 
previous quest icn position studies. SB and 3*'^ groups did not difx'er 
on P itaa retention but the oA . roup \rss better than the SB rjro'.ap on 
RP iteris* 

Apparently the question position phuao.isnon is robust with respect, 
to the manipulations of Ins tr 'Actional sets eaplofed in this study. 
Sither uhe inforia^ition search Hiodel is not a viable one or for one 
rev,.son or another the instructions failed to tnodify matheinagenic pro- 
cesses in any substantial /.lanner. 

One reason which occiired to us \-ihy instructions do not have a 
stronger effect on the QB - QA difference for IIP retention is that 
Ss in the Ql> groups still have to read NP material in order to deteriine 
its pertinence for answerin^,^ tne adjunct question. Such an hypothesis 
would Lnply that retention of MP laaterials which follow P material in 
the text should show greater QB -QA differences than the opposite sit- 
uation, fortunately the experiuantal mz^terials were constructed so 
that half of the time the P content appeared earlj'* in th'3 passage, 
late in the others. The data were recual^^zed addin.^ as a repeated 
measure the factor labeled Order which referred to v'tiether the P rriateripl 
pireceded or follu';jed the li? jnaterial. We expected and found no main 
effects or interactions for Question position, Instructions, or Order 
on P retention. On KP retei^tion, we expected N? content i:hich followed 



P content to be less well recalled than NP content which precedfed 
P content since in the latter situation the NP material would still 
have to be read and determined as pertinent or not to the adjunct 
question. That was in fact the case {F-^f^Q = 28.6lj p <.01). It 
was further expected that the question position effect would be strong- 
est when NP mterial followed the P material and especially x^hen in- 
structions to S were that only the adjunct questions vrould reappear 
in the criterion test. The necessary triple order interaction was 
in fact significant (F^jl^S = 5.65j P<.05) but the relation was not 
as expected, figure 1 shows this interaction. The question position 
difference remains stable on order 1 (NP second) and order 2 (MP first) 
for "Part" instructions. But with a "Total" instructional set the 
adTO.ntage for the QA group is greatest when the NP material is first 
in the passage, a finding directly coutradLctory to that oredicted 
by the information search model. 



Insert Figure 1 About Here 



Frase (1968) has also examined content location in those same 
materials and found results contra dictorj-- to ours. He found that 
higher NP retention was achieved if the NP material folloi^ed the P 
material, regardless of question location. To further evaluate the 
reliability of our finding, a reanalysis of an earlier study using 
the same materials (Keller and Cunningham, 1972) was made. That 
reanalysis showed that once again NP retention was higher when It 



preceded P. content than vjhen it followed • P. oossible reason for the 
discrepancy between /rase^s (1968) results and ours is that he uned a 
between subjects design while xje used a within subjects design* The 
Ss in i'rase's study could come to rely upon NP or P content being 
located in specific portions of the passage and adjust their reading 
strate.'sies to search ijnmed Lately for the P content. Ss in QB groups 
in Frase^s study were apparently more likely to continue reading 
after locating P content than were our Ss although Fig* 1 shows no 
decline in retention of HP materials for the vjB group under "Total" 
instructions* 

An interesting outcome of reanalyzing the Keller and Cunningham 
(1972) experLnient is the."- it allovrs us to compare the performance of 
Ss who were left uninstructed concerning the relationship between 
adjunct questions and the criterion test vith those given "Part" and 
"Total" instructions in the present experiment* Figure 2 shows the 
Interaction between Question position and Order from Keller and Gun- 
ain^am (1972) and the similarity between this interaction and that 
for Ss under "Total" instructions in this experiment is clear* Appar- 
ently, although this hypothesis needs test, Ss in prior question po- 
sition studies uere operating as if the adjunct questions vrere the 
only questions which would appear on the criterion test* 



Insert Figure 2 About Here 



A tentative explanation for the data shown in Fig. 1 and Fig* 2 
might be as follows* Vftien NP information is first in the passaje. 



It Is better remembered than v/hen it is second (when it follows P 
content) for reasons elaborated above, v/lien QB Ss are given "Total" 
instructions, however, NP materi'l -^hich appears first is not remem- 
bered better than NP mater .ia: appears later. All information 
other than P information is apparently regarded as irrelevant and 
treated eqaivalently. The search for pertinent content is not syste-* 
matic and orderly, preceding from the first sentence, to the second, 
and so forth. The S is just as likely to start in the middle or the 
end of the passage as in the beginning. Since many of the questions 
were of a specific, factual nature requiring a number, date, or name 
which could be easily spotted in a cursory search, it is not unlikely 
that these Ss were selectively attending to a much greater extent than 
any other. The fact that they completed reading more quickly than any 
other group lends some support to this interpretation. Such a "selective" 
strategy is incompatable with the demands placed upon any other treat- 
ment groupj that is, learning outcomes as described by the instructions 
could not be raa:cimimzed by using this strategy in any other of the 
groups. Ss will generally eiaploy that strategy which will maximize 
learning outcomes but which is also the least 3ffortfii!l^ a phenonme- 
non lioldikcpf (1970) has labeled i^the "law of least effort." This 
"law" is one of the basic assumptions of the information search model* 

We had expected much stronger effects from the manipulation of 
instructional sets employed in this study. Keller and Cunningham (1972) 
also failed to show strong differences in mathemagenic processing as 
a function of environmental constraints, and an explanation offered 
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by Keller and Cunningham (1972) is probably relevant here as well — 
S motivation. Motivation appeared to oe relatively high in our Ss 
and the relatively brief experimental treatment probably was not per- 
ceived by many Ss as an imposition. As i^rase, Patrick and Schumer 
(1970) nave shown, inathemagenic behaviors are relatively impervious 
to manipulation at high motivation levels. The same hypotheses tested 
by Keller and Cunningham (1972) and in the present study should cer- 
tainly be tested at different incentive or arousal levels. 

It is also clear that the information search model of mathemagenic 
processes needs revision and elaboration. The inclusion of motivational 
variables is one such possibility. Also in need of revision is the 
notion that the inforination search is always entirely orderly and in 
accordance with a particular sequence. Nevertheless, it does appear 
that hypothetical S strategies do have some predictive power and should 
provide some important insights into the process of learning by reading. 
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Fig. 1. Significant interaction between Question position. 
Instructions, and Order 
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Fig*. 2. Significant in teraction between Question position 
and Order from Keller and Cunningham (1972) 



